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DETAILED ACTION 

Response to Arguments 

1. Applicant's arguments filed 09 December 2005 have been 
fully considered but they are not persuasive. Note that 
since the facsimile copy does not clearly show page numbers 
at the bottom, the page with the heading " REMARKS " will be 
considered page 1 for the purpose of the present Response 
to Arguments . 

Regarding page 1, lines 7-12: Applicants arguments 
herein with respect to claims 80 and 81 are persuasive and 
the amendment to claim 80 noted. The rejection of claim 81 
under 35 USC §112, 2 nd paragraph has therefore been 
withdrawn. 

Regarding page 1, line 13 to page 3, line 13: The 

present amendments to the claims have been fully 
considered. New grounds of rejection, which have been 
necessitated by the present amendments to the claims, are 
presented in detail below. 

Regarding page 3, lines 14-26: Applicant argues that 
there is no motivation to combine Chino (US Patent 
6,118,888) with Sugiyama (US Patent 5,633,723) since the 
two patents disclose unrelated technologies, and therefore 
impermissible hindsight is used. 

Examiner responds that Sugiyama and Chino are clearly 
analogous art since both Sugiyama and Chino are concerned 
with the control and processing of multimedia image data. 
It has been held that a prior art reference must either be 
in the field of applicant's endeavor or, if not, then be 
reasonably pertinent to the particular problem with which 
the applicant was concerned, in order to be relied upon as 
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a basis for rejection of the claimed invention. See In re 
Oetiker, 977 F.2d 1443, 24 USPQ2d 1443 (Fed, Cir. 1992). 

Furthermore, one of ordinary skill in the art at the 
time of the invention would clearly have been motivated to 
combine the references since applying the teachings of 
Chino to the system of Sugiyama would allow the user to 
smoothly communicate with the system (column 7, lines 58-64 
of Chino) [see page 5, lines 22-25 of the previous office 
action, dated 02 August 2005 and mailed 09 August 2005] . 

Finally, it must be recognized that any judgment on 
obviousness is in a sense necessarily a reconstruction 
based upon hindsight reasoning. But so long as it takes 
into account only knowledge which was within the level of 
ordinary skill at the time the claimed invention was made, 
and does not include knowledge gleaned only from the 
applicant's disclosure, such a reconstruction is proper. 
See In re McLaughlin, 443 F.2d 1392, 170 USPQ 209 (CCPA 
1971) . In the case of combining Sugiyama and Chino, the 
teachings and the motivation to combine the references have 
come from the references themselves, and not from 
Applicant's present disclosure. 

Claim Rejections - 35 USC §102 

2. The following is a quotation of the appropriate 
paragraphs of 35 U.S.C. 102 that form the basis for the 
rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in 
this or a foreign country or in public use or on sale in this country, 
more than one year prior to the date of application for patent in the 
United States. 
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3. Claims 78, 92 and 112 are rejected under 35 

U.S.C. 102(b) as being anticipated by Sugiyama (US Patent 
5, 633, 723) . 

Regarding claim 78: Sugiyama discloses receiving 
time-based media data from a media source (column 3, lines 
12-17 of Sugiyama) ; receiving a user selection of a multi- 
media function (column 3, lines 41-50 of Sugiyama) , the 
multimedia function including criteria to be applied to 
time-based media data (column 3, lines 57-63 of Sugiyama); 
performing the multimedia function on the time-based media 
data (column 3, lines 57-63 of Sugiyama) to identify a 
portion of the time-based media data matching the included 
criteria (figure 4 and column 3, line 61 to column 4, line 
3 of Sugiyama) ; producing output on a printer from the 
identified portion of the time-based media data (column 4, 
lines 45-47 and line 52-54 of Sugiyama) ; and producing an 
electronic output of the identified portion of the time- 
based media data (column 4, lines 25-35 of Sugiyama) . 

Regarding claim 92: Sugiyama discloses selecting a 
range of video data in response to received input from the 
user (column 3, lines 45-48 of Sugiyama) . 

Regarding claim 112: Sugiyama discloses that the 
multimedia function includes applying a visual inspection 
function to the time-based media data (column 5, lines 56- 
65 of Sugiyama) . 

Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S.C. 103(a) which 
forms the basis for all obviousness rejections set forth in 
this Office action: 

(a) A patent may not be obtained though the invention is not 
identically disclosed or described as set forth in section 102 of 
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this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a 
whole would have been obvious at the time the invention was made to a 
person having ordinary skill in the art to which said subject matter 
pertains. Patentability shall not be negatived by the manner in 
which the invention was made . 

5. Claims 1-4, 7-8, 15-16, 18-23, 35, 42-43, 50, 62, 74, 
79-81, 84-85, 93 and 95-100 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 
5,633,723) in view of Chino (US Patent 6,118,888). 

Regarding claim 1: Sugiyama discloses a printer 
(figure 1 of Sugiyama) for printing (column 6, lines 19-26 
of Sugiyama) time-based media data (column 3, lines 12-17 
of Sugiyama) , the printer comprising a communication 
interface (figure 1(11) of Sugiyama) for receiving time- 
based media data from a media source (column 3, lines 12-17 
of Sugiyama); a processor (figure 1(15) of Sugiyama) for 
performing a multimedia function on the time-based media 
data (column 3, lines 57-63 of Sugiyama) to identify a 
portion of the time-based media data (figure 4 and column 
3, line 61 to column 4, line 3 of Sugiyama) corresponding 
to criteria (column 3, lines 57-63 of Sugiyama) received 
from the user (column 3, lines 41-50 of Sugiyama) ; and a 
user interface (figure 1(20-25) of Sugiyama), communica- 
tively coupled to the processor (column 3, lines 41-44 of 
Sugiyama), including a display (figure 1(20) of Sugiyama) 
for providing data to the user (column 3, lines 45-50 of , 
Sugiyama) and an input device (figure 1(21-25) of Sugiyama) 
for receiving data from the user (column 3, lines 41-50 of 
Sugiyama). The collection of input keys (figure 1(21-25) 
of Sugiyama), along with the display (figure 1(20) of 
Sugiyama) which responds according to the inputs given by 
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the collection of input keys (column 3, lines 41-50 of 
Sugiyama) , forms the overall user interface. 

Sugiyama further discloses a first output device 
(figure 1(32-33) and column 7, lines 48-53 of Sugiyama) for 
receiving the identified portion of the time-based media 
data from the processor and producing output on a printer 
(column 4, lines 45-47 and line 52-54 of Sugiyama) ; and a 
second output device (figure 1(20) of Sugiyama) coupled to 
the processor for receiving the identified portion of the 
time-based media data and producing an electronic output 
from the image (column 4, lines 25-35 of Sugiyama) . The 
head driver (figure 1(32) of Sugiyama) and thermal head 
(figure 1(33) of Sugiyama) together comprise the overall 
output printing device (column 7, lines 48-53 of Sugiyama), 
which produces a printed output of the resultant video 
image data (column 4, lines 35-42 of Sugiyama) . As can be 
seen in figure 1 of Sugiyama, the display is coupled to the 
processor through the monitor driver (figure 1(19) of 
Sugiyama), digital-to-analog converter (figure 1(18) of 
Sugiyama), and selector (figure 1(17) of Sugiyama). 

Sugiyama does not disclose expressly that the display 
of said user interface is a separate component from the 
second output device. 

Chino discloses a user interface (figure 12 (305a, 306a) 
of Chino) for user input that includes a display (figure 4 
and column 7, lines 48-54 of Chino) that is separate 
(column 15, lines 45-50 of Chino) from the other output 
devices (figure 12 (308a) and column 15, lines 53-54 of 
Chino) . There are several different devices and types of 
devices used for producing an output of the resultant 
multimedia data (column 15, lines 53-54 of Chino) . The 
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display through which the user interacts with the overall 
system (figure 4 of Chino) is separate from the output 
devices (column 7, lines 48-54 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely multimedia image 
data processing and control. At the time of the invention, 
it would have been obvious to a person of ordinary skill in 
the art to have a separate user interface for the user, as 
taught by Chino. The motivation for doing so would have 
been to allow the user to smoothly communicate with the 
system (column 7, lines 58-64 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to 
obtain the invention as specified in claim 1. 

Regarding claims 2 and 79: Sugiyama does not disclose 
expressly that said multimedia function includes selecting 
a range of audio data in response to received input from 
the user. 

Chino discloses selecting a range of audio data in 
response to received input from the user (column 14, lines 
8-18 of Chino) . Only the audio data that is intended to be 
input by the user is input in response to the appropriate 
user input, while any other noise is ignored by the system 
(column 14, lines 8-18 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to allow the user to input only a 
specifically desired range of audio data, as taught by 
Chino. The motivation for doing so would have been to 
prevent unintended and erroneous audio input (column 14, 
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lines 10-11 of Chino) . Therefore, it would have been 
obvious to combine Chino with Sugiyama to obtain the 
invention as specified in claims 2 and 79. 

Regarding claims 3 and 80: Sugiyama does not disclose 
expressly that said multimedia function includes applying 
audio event detection to the time-based media data. 

Chino discloses applying audio event detection to the 
time-based media data (column 14, lines 8-18 of Chino) . 
The system detects when audio data is intended to be input 
by the user, while any other noise is ignored by the system 
(column 14, lines 8-18 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to detect audio data events, as 
taught by Chino. The motivation for doing so would have 
been to prevent unintended and erroneous audio input 
(column 14, lines 10-11 of Chino) . Therefore, it would 
have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 3 and 80. 

Regarding claims 4 and 81: Sugiyama does not disclose 
expressly that the multimedia function includes determining 
a confidence level associated with the audio event 
detection. 

Chino discloses that an audio event is detected 
(column 14, lines 8-11 of Chino) based on specific criteria 
that are to be met to the satisfaction of a computer 
automated system (column 14, lines 11-19 of Chino) . Thus, 
a confidence level associated with the audio event 
detection is determined. 
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Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to detect audio data events based 
on a determined confidence level, as taught by Chino. The 
motivation for doing so would have been to prevent 
unintended and erroneous audio input (column 14, lines 10- 
11 of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claims 4 and 81. 

Regarding claims 7 and 84: Sugiyama does not disclose 
expressly that said multimedia function includes applying a 
sound source localization function to the time-based media 
data . 

Chino discloses applying a sound source localization 
function to time-based media data (column 13, lines 5-14 of 
Chino) . By using the gaze object detection portion of the 
multi-modal interface apparatus, the audio sound source 
localization is determined. 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to configure the user interface 
to apply a sound source localization function to the time- 
based media data, as taught by Chino. The motivation for 
doing so would have been to ensure that user input is 
intended, and the user is not speaking to someone else 
(column 1, lines 52-58 of Chino) . Therefore, it would have 
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been obvious to combine Chino with Sugiyama to obtain the 
invention as specified in claims 7 and 84. 

Regarding claims 8 and 85: Sugiyama does not disclose 
expressly that said multimedia function includes applying 
audio event detection to the time-based media data. 

Chino discloses applying audio event detection to the 
time-based media data (column 14, lines 8-18 of Chino) . 
The system detects when audio data is intended to be input 
by the user, while any other noise is ignored by the system 
(column 14, lines 8-18 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to detect audio data events, as 
taught by Chino. The motivation for doing so would have 
been to prevent unintended and erroneous audio input 
(column 14, lines 10-11 of Chino) . Therefore, it would 
have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 8 and 85. 

Regarding claim 15: Sugiyama discloses selecting a 
range of video data in response to received input from the 
user (column 3, lines 45-48 of Sugiyama) . 

Regarding claims 16 and 93: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying a video event detection function to the time-based 
media data. 

Chino discloses applying a video event detection 
function to the time-based media data (column 7, lines 33- 
40 of Chino) . 
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Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data* At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to configure the user interface 
to apply a video event detection function to the time-based 
media data, as taught by Chino. The motivation for doing 
so would have been to be able to apply user gestures as 
another form of data input (column 7, lines 38-45 of 
Chino) • Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 16 and 93. 

Regarding claims 18 and 95: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying a face detection function to the time-based media 
data . 

Chino discloses applying a face detection function to 
time-based media data (figure 20(406) and column 24, lines 
25-27 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a face detection 
function to time-based media data, as taught by Chino. The 
motivation for doing so would have been to determine which 
particular user corresponds to the current user by 
recognition of the current user's face (column 26, lines 
20-22 of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claims 18 and 95. 
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Further regarding claims 19 and 96: Chino discloses 
applying a clustering function to the time-based media data 
to merge multiple instances of a face into a representative 
image (column 26, lines 1-12 of Chino) . 

Regarding claims 20 and 97: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying a face recognition function to the time-based 
media data, 

Chino discloses applying a face recognition function 
to time-based media data (figure 20(406) and column 24, 
lines 25-27 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a face recognition 
function to time-based media data, as taught by Chino. The 
motivation for doing so would have been to determine which 
particular user corresponds to the current user by recog- 
nition of the current user's face (column 26, lines 20-22 
of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claims 20 and 97. 

Regarding claims 21 and 98: Sugiyama does not 
disclose expressly that the multimedia function includes 
applying an optical character recognition function to the 
time-based media data. 

Chino discloses applying an optical character 
recognition function to time-based media data (figure 3 
(102 j) and column 7, lines 14-18 of Chino) . 
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Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply an optical character 
recognition function to time-based media data, as taught by 
Chino. The suggestion for doing so would have been that 
character recognition from an electronic pen is simply 
another useful electronic means to input data into a 
computerized system (figure 3 and column 7, lines 2-11 of 
Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 21 and 98. 

Further regarding claims 22 and 99: Chino discloses 
applying a clustering function to the time-based media data 
to merge similar results of the optical character 
recognition (column 7, lines 15-21 of Chino) . The 
particular language input by the user, such as German, 
Russian and Chinese, which use different character sets, is 
detected. The particular language determines the cluster 
of characters to use in optical character recognition 
(column 7, lines 15-21 of Chino) . 

Regarding claims 23 and 100: Sugiyama does not 
disclose expressly that the multimedia function includes 
applying a motion analysis function to the time-based media 
data . 

Chino discloses applying a motion analysis function to 
time-based media data (figure 3(102f) and column 7, lines 
33-38 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
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processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a motion analysis 
function to time-based media data, as taught by Chino. The 
suggestion for doing so would have been that detection of a 
user's motion and gestures is simply another useful 
electronic means to input data into a computerized system 
(figure 3 and column 7, lines 2-11 of Chino) . Therefore, 
it would have been obvious to combine Chino with Sugiyama 
to obtain the invention as specified in claims 23 and 100. 

Regarding claim 35: Sugiyama discloses that the 
multimedia function includes applying a visual inspection 
function to the time-based media data (column 5, lines 56- 
65 of Sugiyama) . 

Regarding claim 42: Sugiyama does not disclose 
expressly that said user interface is configured to allow a 
user to control audio sound localization hardware. 

Chino discloses controlling audio sound localization 
hardware (column 13, lines 5-14 of Chino) . By using the 
gaze object detection portion of the multi-modal interface 
apparatus, the audio sound localization is determined. 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to configure said user interface 
to allow a user to control audio sound localization 
hardware, as taught by Chino. The motivation for doing so 
would have been to ensure that user input is intended, and 
the user is not speaking to someone else (column 1, lines 
52-58 of Chino) . Therefore, it would have been obvious to 
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combine Chino with Sugiyama to obtain the invention as 
specified in claim 42. 

Regarding claim 43: Sugiyama does not disclose 
expressly that said user interface is configured to allow a 
user to control motion detection hardware, 

Chino discloses controlling motion detection hardware 
(figure 3(102f) and column 7, lines 33-38 of Chino). 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to configure said user interface 
to allow a user to control motion detection hardware, as 
taught by Chino. The suggestion for doing so would have 
been that detection of a user's motion and gestures is 
simply another useful electronic means to input data into a 
computerized system (figure 3 and column 7, lines 2-11 of 
Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claim 43. 

Regarding claim 50: Sugiyama discloses that the 
processor is further configured to display results of the 
multimedia function on the display of the user interface 
(column 4, lines 30-35 of Sugiyama) . 

Regarding claim 62: Sugiyama does not disclose 
expressly that the second output device is audio sound 
localization hardware. 

Chino discloses controlling as an output device audio 
sound localization hardware (column 13, lines 5-14 of 
Chino) . By using the gaze object detection portion of the 
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multi -modal interface apparatus, the audio sound 
localization is determined. 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to output audio data through 
audio sound localization hardware, as taught by Chino. The 
motivation for doing so would have been to ensure that user 
input is intended, and the user is not speaking to someone 
else (column 1, lines 52-58 of Chino) . Therefore, it would 
have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claim 62. 

Regarding claim 74: Sugiyama does not disclose 
expressly that the second output device is hardware for 
capturing data from an electronic pen. 

Chino discloses controlling as an output device 
hardware for capturing data from an electronic pen (figure 
3(102i) and column 7, lines 14-16 of Chino). 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of digital data. At the time of the invention, 
it would have been obvious to a person of ordinary skill in 
the art to use hardware for capturing data from an 
electronic pen, as taught by Chino. The suggestion for 
doing so would have been that an electronic pen is simply 
another useful output device that provides digital data a 
user may wish to obtain (figure 3 and column 6, lines 66-67 
of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claim 74. 
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6. Claims 5-6 and 82-83 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 
5,633,723) in view of Chino (US Patent 6,118,888) and 
Kametani (US Patent 5,091,948). 

Regarding claims 5 and 82: Sugiyama in view of Chino 
does not disclose expressly that said multimedia function 
includes applying a speaker segmentation function to the 
time-based media data. 

Kametani discloses applying a speaker segmentation 
function to time-based media data (figure 3d and column 5, 
lines 5-9 and lines 29-33 of Kametani) . 

Sugiyama in view of Chino is combinable with Kametani 
because they are from the same field of endeavor, namely 
the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a speaker 
segmentation function to said time-based media data, as 
taught by Kametani. The motivation for doing so would have 
been that using a speaker segmentation function extracts 
parameters that uniquely identify a speaker, thus improving 
the level of speaker discrimination (column 5, lines 29-35 
of Kametani) . Therefore, it would have been obvious to 
combine Kametani with Sugiyama in view of Chino to obtain 
the invention as specified in claims 5, 13, 82 and 90. 

Further regarding claims 6/1, 6/5, and 83/78, 83/82: 
Kametani discloses applying a speaker recognition function 
to said time-based media data (column 5, lines 29-35 of 
Kametani) . 


Application/Control Number: 10/814,700 
Art Unit: 2625 


Page 


7. Claims 9-11, 14, 86-88 and 91 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Sugiyama (US 
Patent 5,633,723) in view of Chino (US Patent 6,118,888) 
and Halverson (US Patent Application Publication 
2002/0101513 Al) . 

Regarding claims 9 and 86: Sugiyama in view of Chino 
does not disclose expressly that said multimedia function 
includes applying a speech recognition function to said 
time-based media data. 

Halverson discloses applying a speech recognition 
function to time-based media data (para. 24, lines 2-5 and 
para. 25, lines 21-23 of Halverson). 

Sugiyama in view of Chino is combinable with Halverson 
because they are from the same field of endeavor, namely 
the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a speech 
recognition function, as taught by Halverson. The motiva- 
tion for doing so would have been that speech is a useful 
and natural form of human input (para. 25, lines 11-14 of 
Halverson) . Therefore, it would have been obvious to 
combine Halverson with Sugiyama in view of Chino to obtain 
the invention as specified in claims 9 and 86. 

Further regarding claims 10 and 87: Halverson 
discloses applying a profile analysis function to the time- 
based media data (para. 23, lines 4-7 of Halverson) . 

Regarding claims 11 and 88: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying audio event detection to the time-based media 
data . 
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Chino discloses applying audio event detection to the 
time-based media data (column 14, lines 8-18 of Chino) . 
The system detects when audio data is intended to be input 
by the user, while any other noise is ignored by the system 
(column 14, lines 8-18 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to detect audio data events, as 
taught by Chino. The motivation for doing so would have 
been to prevent unintended and erroneous audio input 
(column 14, lines 10-11 of Chino) . Therefore, it would 
have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 11 and 88. 

Regarding claims 14 and 91: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying a sound source localization function to the time- 
based media data. 

Chino discloses applying a sound source localization 
function to time-based media data (column 13, lines 5-14 of 
Chino) . By using the gaze object detection portion of the 
multi-modal interface apparatus, the audio sound source 
localization is determined. 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to configure the user interface 
to apply a sound source localization function to the time- 
based media data, as taught by Chino. The motivation for 
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doing so would have been to ensure that user input is 
intended, and the user is not speaking to someone else 
(column 1, lines 52-58 of Chino) . Therefore, it would have 
been obvious to combine Chino with Sugiyama to obtain the 
invention as specified in claims 14 and 91. 

8. Claims 12-13 and 89-90 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 
5,633,723) in view of Chino (US Patent 6,118,888), 
Halverson (US Patent Application Publication 2002/0101513 
Al) and Kametani (US Patent 5,091,948). 

Regarding claims 12 and 89: Sugiyama in view of Chino 
and Halverson does not disclose expressly that said multi- 
media function includes applying a speaker recognition 
function to said time-based media data. 

Kametani discloses applying a speaker recognition 
function to said time-based media data (column 5, lines 29- 
35 of Kametani) . 

Sugiyama in view of Chino and Halverson is combinable 
with Kametani because they are from the same field of 
endeavor, namely the control and processing of time-based 
media data. At the time of the invention, it would have 
been obvious to a person of ordinary skill in the art to 
apply a speaker recognition function to said time-based 
media data, as taught by Kametani. The motivation for 
doing so would have been that using a speaker recognition 
function extracts parameters that uniquely identify a 
speaker, thus improving the level of speaker discrimination 
(column 5, lines 29-35 of Kametani) . Therefore, it would 
have been obvious to combine Kametani with Sugiyama in view 
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of Chino and Halverson to obtain the invention as specified 
in claims 12 and 89. 

Regarding claims 13 and 90: Sugiyama in view of Chino 
and Halverson does not disclose expressly that said 
multimedia function includes applying a speaker segmen- 
tation function to the time-based media data. 

Kametani discloses applying a speaker segmentation 
function to time-based media data (figure 3d and column 5, 
lines 5-9 and lines 29-33 of Kametani) . 

Sugiyama in view of Chino and Halverson is combinable 
with Kametani because they are from the same field of 
endeavor, namely the control and processing of time-based 
media data. At the time of the invention, it would have 
been obvious to a person of ordinary skill in the art to 
apply a speaker segmentation function to said time-based 
media data, as taught by Kametani. The motivation for 
doing so would have been that using a speaker segmentation 
function extracts parameters that uniquely identify a 
speaker, thus improving the level of speaker discrimination 
(column 5, lines 29-35 of Kametani) . Therefore, it would 
have been obvious to combine Kametani with Sugiyama in view 
of Chino and Halverson to obtain the invention as specified 
in claims 13 and 90. 

9. Claims 17, 76 and 94 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 
5,633,723) in view of Chino (US Patent 6,118,888) and Krumm 
(US Patent 6, 611, 622 Bl) . 

Regarding claims 17 and 94: Sugiyama in view of Chino 
does not disclose expressly that said multimedia function 
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includes applying a color histogram analysis function to 
said time-based media data. 

Krumm discloses applying a color histogram analysis 
function to time-based media data (figure 2(202) and column 
8, lines 46-47 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm 
because they are from the same field of endeavor, namely 
control and processing of time-based media data. At the 
time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a color 
histogram analysis function to the time-based media data, 
as taught by Krumm. The motivation for doing so would have 
been to better identify people or objects in scenes 
generated subsequent to a model scene (column 8, lines 53- 
58 of Krumm) . Therefore, it would have been obvious to 
combine Krumm with Sugiyama in view of Chino to obtain the 
invention as specified in claims 17 and 94. 

Regarding claim 76: Sugiyama in view of Chino does 
not disclose expressly that the second output device is a 
flash memory device. 

Krumm discloses outputting computer data to a flash 
memory device (column 7, lines 27-33 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm 
because they are from the same field of endeavor, namely 
control and processing of time-based media data. At the 
time of the invention, it would have been obvious to a 
person of ordinary skill in the art to have the second 
output device be the flash memory device taught by Krumm. 
The suggestion for doing so would have been that a flash 
memory device is one of many possible useful output devices 
available to those of ordinary skill in the art (column 7, 
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lines 27-36 of Krumm) . Therefore, it would have been 
obvious to combine Krumm with Sugiyama in view of Chino to 
obtain the invention as specified in claim 76. 

10. Claims 24/1, 24/23 and 101/100 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Sugiyama (US 
Patent 5,633,723) in view of Chino (US Patent 6,118,888) 
and Kim (US Patent 6,594,377 Bl). 

Regarding claims 24/1, 24/23, and 101/100: Sugiyama 
in view of Chino does not disclose expressly that said 
multimedia function includes a distance estimation function 
to the time-based media data. 

Kim discloses applying a distance estimation to image 
media data (column 3, lines 33-36 of Kim) . 

Sugiyama in view of Chino is combinable with Kim 
because they are from the same field of endeavor, namely 
the control and processing of media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to apply distance estimation, as 
taught by Kim, to the time-based media data. The 
motivation for doing so would have been to determine if the 
user, or a relevant part of the user, is within the 
required operational range (column 4, lines 28-34 of Kim) . 
Therefore, it would have been obvious to combine Kim with 
to Sugiyama in view of Chino obtain the invention as 
specified in claims 24/1, 24/23 and 101/100. 

11. Claim 101/78 is rejected under 35 U.S.C. 103(a) as 
being unpatentable over Sugiyama (US Patent 5,633,723) in 
view of Kim (US Patent 6,594,377 Bl) . 
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Regarding claim 101/78: Sugiyama does not disclose 
expressly that said multimedia function includes a distance 
estimation function to the time-based media data. 

Kim discloses applying a distance estimation to image 
media data (column 3, lines 33-36 of Kim) . 

Sugiyama and Kim are combinable because they are from 
the same field of endeavor, namely the control and 
processing of media data. At the time of the invention, it 
would have been obvious to a person of ordinary skill in 
the art to apply distance estimation, as taught by Kim, to 
the time-based media data. The motivation for doing so 
would have been to determine if the user, or a relevant 
part of the user, is within the required operational range 
(column 4, lines 28-34 of Kim) . Therefore, it would have 
been obvious to combine Kim with Sugiyama to obtain the 
invention as specified in claim 101/78. 

12. Claims 25-31 and 102-108 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 
5,633,723) in view of Chino (US Patent 6,118,888) and Krumm 
(US Patent 6, 611, 622 Bl) . 

Regarding claims 25 and 102: Sugiyama in view of 
Chino does not disclose expressly that said multimedia 
function includes applying a foreground/background 
segmentation function to said time-based media data. 

Krumm discloses applying a foreground/background 
segmentation function to time-based media data (column 10, 
lines 13-15 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm 
because they are from the same field of endeavor, namely 
control and processing of time-based media data. At the 
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time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a foreground/ 
background segmentation function to the time-based media 
data, as taught by Krumm. The motivation for doing so 
would have been that the foreground segment is needed to 
further segment for the purpose of identifying people and 
objects in an image (column 10, lines 15-18 of Krumm) . 
Therefore, it would have been obvious to combine Krumm with 
Sugiyama in view of Chino to obtain the invention as 
specified in claims 25 and 102. 

Regarding claims 26 and 103: Sugiyama in view of 
Chino does not disclose expressly that said multimedia 
function includes applying a scene segmentation function to 
said time-based media data. 

Krumm discloses applying a scene segmentation function 
to time-based media data (column 10, lines 15-18 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm 
because they are from the same field of endeavor, namely 
control and processing of time-based media data. At the 
time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a scene 
segmentation function to the time-based media data, as 
taught by Krumm. The motivation for doing so would have 
been that segmenting the foreground scene is needed to 
identify people and objects in an image (column 10, lines 
15-18 of Krumm) . Therefore, it would have been obvious to 
combine Krumm with Sugiyama in view of Chino to obtain the 
invention as specified in claims 26 and 103. 

Regarding claims 27 and 104 : Sugiyama does not 
disclose expressly that said multimedia function includes 
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applying a face recognition function to the time-based 
media data. 

Chino discloses applying a face recognition function 
to time-based media data (figure 20(406) and column 24, 
lines 25-27 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a face recognition 
function to time-based media data, as taught by Chino. The 
motivation for doing so would have been to determine which 
particular user corresponds to the current user by 
recognition of the current user's face (column 26, lines 
20-22 of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claims 27 and 104. 

Regarding claims 28 and 105: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying a face detection function to the time-based media 
data . 

Chino discloses applying a face detection function to 
time-based media data (figure 20(406) and column 24, lines 
25-27 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a face detection 
function to time-based media data, as taught by Chino. The 
motivation for doing so would have been to determine which 
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particular user corresponds to the current user by recog- 
nition of the current user's face (column 26, lines 20-22 
of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claims 28 and 105. 

Regarding claims 29 and 106: Sugiyama does not 
disclose expressly that the multimedia function includes 
applying an optical character recognition function to the 
time-based media data. 

Chino discloses applying an optical character recog- 
nition function to time-based media data (figure 3(102j) 
and column 7, lines 14-18 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply an optical character 
recognition function to time-based media data, as taught by 
Chino. The suggestion for doing so would have been that 
character recognition from an electronic pen is simply 
another useful electronic means to input data into a 
computerized system (figure 3 and column 7, lines 2-11 of 
Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 29 and 106. 

Regarding claims 30 and 107: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying a face recognition function to the time-based 
media data. 
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Chino discloses applying a face recognition function 
to time-based media data (figure 20(406) and column 24, 
lines 25-27 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a face recognition 
function to time-based media data, as taught by Chino. The 
motivation for doing so would have been to determine which 
particular user corresponds to the current user by recog- 
nition of the current user's face (column 26, lines 20-22 
of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claims 30 and 107. 

Regarding claims 31 and 108: Sugiyama does not 
disclose expressly that said multimedia function includes 
applying a face detection function to the time-based media 
data . 

Chino discloses applying a face detection function to 
time-based media data (figure 20(406) and column 24, lines 
25-27 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a face detection 
function to time-based media data, as taught by Chino. The 
motivation for doing so would have been to determine which 
particular user corresponds to the current user by 
recognition of the current user's face (column 26, lines 
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20-22 of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as 
specified in claims 31 and 108. 

13. Claims 32-34 and 109-111 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 
5,633,723) in view of Chino (US Patent 6,118,888) and 
Gerber (US Patent 5,568,406). 

Regarding claims 32 and 109: Sugiyama in view of 
Chino does not disclose expressly that said multimedia 
function includes applying an automobile recognition 
function to said time-based media data. 

Gerber discloses applying an automobile recognition 
function to time-based media data (column 8, lines 42-45 of 
Gerber) . 

Sugiyama in view of Chino is combinable with Gerber 
because they are from the same field of endeavor, namely 
the control and processing of time-based image data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply an automobile 
recognition function to said time-based media data, as 
taught by Gerber. The motivation for doing so would have 
been to determine from the time-based media data whether or 
not the automobile in the time-based media data is stolen 
(column 8, lines 45-46 of Gerber) . Therefore, it would 
have been obvious to combine Gerber with Sugiyama in view 
of Chino to obtain the invention as specified in claims 32 
and 109. 

Regarding claims 33 and 110: Sugiyama does not 
disclose expressly that the multimedia function includes 
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applying a motion analysis function to the time-based media 
data . 

Chino discloses applying a motion analysis function to 
time-based media data (figure 3(102f) and column 7, lines 
33-38 of Chino) . 

Sugiyama and Chino are combinable because they are 
from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to apply a motion analysis 
function to time-based media data, as taught by Chino. The 
suggestion for doing so would have been that detection of a 
user's motion and gestures is simply another useful 
electronic means to input data into a computerized system 
(figure 3 and column 7, lines 2-11 of Chino) . Therefore, 
it would have been obvious to combine Chino with Sugiyama 
to obtain the invention as specified in claims 33 and 110. 

Regarding claims 34 and 111: Sugiyama in view of 
Chino does not disclose expressly that said multimedia 
function includes applying a license plate recognition 
function to said time-based media data. 

Gerber discloses applying a license plate recognition 
function to time-based media data (column 3, lines 42-47 
and lines 63-64 of Gerber) . 

Sugiyama in view of Chino is combinable with Gerber 
because they are from the same field of endeavor, namely 
the control and processing of time-based image data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a license 
plate recognition function to said time-based media data, 
as taught by Gerber. The motivation for doing so would 
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have been to determine from the time-based media data 
whether or not the automobile in the time-based media data 
is stolen (column 1, line 66 to column 2, line 2 of 
Gerber) . Therefore, it would have been obvious to combine 
Gerber with Sugiyama in view of Chino to obtain the 
invention as specified in claims 34 and 111, 

14, Claims 36-39, 44-45, 47, 51-58, 63, 65, 73 and 75 are 
rejected under 35 U.S.C. 103(a) as being unpatentable over 
Sugiyama (US Patent 5,633,723) in view of Chino (US Patent 
6,118,888) and Hymel (US Patent Application Publication 
2003/0220988 Al ) . 

Regarding claims 36-39, 44-45 and 47: Sugiyama in 
view of Chino does not disclose expressly that said user 
interface is configured to allow a user to control a 
compact disc (CD) device, a digital video disc (DVD) 
device, an audio tape device, a video tape device, a MIDI 
player, a cellular telephone, and/or a world wide web 
display. 

Hymel discloses a user interface configured to allow a 
user to control (para. 10, lines 1-5 of Hymel) a compact 
disc (CD) device (para. 10, lines 14-15 and lines 19-20 of 
Hymel), a digital video disc (DVD) device (para. 10, lines 
14-15 and lines 20-21 of Hymel), an audio tape device 
(audio tape device is a type of audio player, MP3 player is 
merely an example) (para. 10, lines 14-15 and line 19 of 
Hymel), a video tape device (digital camcorder, which, as 
is well-known in the art, uses a digital video (DV) 
cassette tape) (para. 10, lines 14-15 and line 20 of 
Hymel), a MIDI player (MIDI player is a type of audio 
player, MP3 player is merely an example) (para. 10, lines 
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14-15 and line 19 of Hymel) , a cellular telephone (para. 
10, lines 14-15 of Hymel), and/or a world wide web display 

(figure 1(130) and para. 11, lines 1-10 of Hymel). 

Sugiyama in view of Chino is combinable with Hymel 
because they are from similar problem solving areas, namely 
the control of data storage and output. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to configure said user interface 
so that the user interface allows a user to control a 
compact disc (CD) device, a digital video disc (DVD) 
device, an audio tape device, a video tape device, a MIDI 
player, a cellular telephone, and/or a world wide web 
display, as taught by Hymel. The motivation for doing so 
would have been to allow a user to connect a variety of 
different types of peripheral devices to an overall system, 
thus allowing the user to perform a variety of functions 

(para. 2, lines 1-6 of Hymel) . Therefore, it would have 
been obvious to combine Hymel with Sugiyama in view of 
Chino to obtain the invention as specified in claims 36-39, 
44-45 and 47. 

Regarding claims 51-58, 63, 65, 73 and 75: Sugiyama 
in view of Chino does not disclose expressly that the 
second output device is a DVD drive, CD drive, audio tape 
drive, video cassette device, removable media device, 
embedded audio recorder, embedded video recorder, non- 
volatile storage device, cellular telephone, world-wide web 
display, hardware for performing audio capture, and/or a 
disposable media writer. 

Hymel discloses a user interface configured to allow a 
user to control as an output device (para. 10, lines 1-5 of 
Hymel) a DVD drive (para. 10, lines 14-15 and lines 20-21 
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of Hymel), CD drive (para. 10, lines 14-15 and lines 19-20 
of Hymel), audio tape drive (audio tape drive is a type of 
audio player, MP 3 player is merely an example) (para. 10, 
lines 14-15 and line 19 of Hymel), video cassette device 
(digital camcorder, which, as is well-known in the art, 
uses a digital video (DV) cassette tape) (para. 10, lines 
14-15 and line 20 of Hymel) , removable media device (the 
compact discs used in compact disc devices are well-known 
to be removable media devices) (para. 10, lines 14-15 and 
lines 19-20 of Hymel), embedded (para. 10, lines 22-26 of 
Hymel) audio recorder (para. 10, lines 14-15 and line 19 of 
Hymel), embedded (para. 10, lines 22-26 of Hymel) video 
recorder (para. 10, lines 14-15 and line 20 of Hymel), non- 
volatile storage device (compact disc devices and digital 
video disc devices are well-known to be non-volatile 
storage media devices) (para. 10, lines 14-15 and lines 19- 
21 of Hymel), cellular telephone (para. 10, lines 14-15 of 
Hymel), world-wide web display (figure 1 (130) and para. 
11, lines 1-10 of Hymel), hardware for performing audio 
capture (as is well-known in the art, part of the function 
of a digital camcorder is to capture audio signals, along 
with the video) (para. 10, lines 14-15 and line 20 of 
Hymel), and/or a disposable media writer (compact discs 
(CD-R's) and digital video discs (DVD±R's) are well-known 
to be disposable media) (para. 10, lines 14-15 and lines 
19-21 of Hymel) . 

Sugiyama in view of Chino is combinable with Hymel 
because they are from similar problem solving areas, namely 
the control of data storage and output. At the time of the 
invention, it would have been obvious to a person of 
ordinary skill in the art to have the second output device 
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be a DVD drive, CD drive, audio tape drive, video cassette 
device, removable media device, embedded audio recorder, 
embedded video recorder, non-volatile storage device, 
cellular telephone, world-wide web display, hardware for 
performing audio capture, and/or a disposable media writer, 
as taught by Hymel. The motivation for doing so would have 
been to allow a user to connect a variety of different 
types of peripheral devices to an overall system, thus 
allowing the user to perform a variety of functions (para. 
2, lines 1-6 of Hymel) . Therefore, it would have been 
obvious to combine Hymel with Sugiyama in view of Chino to 
obtain the invention as specified in claims 51-58, 63, 65, 
73 and 75. 

15. Claims 40-41, 49, 59-61, 69 and 77 are rejected under 
35 U.S.C. 103(a) as being unpatentable over Sugiyama (US 
Patent 5,633,723) in view of Chino (US Patent 6,118,888) 
and Stevens (US Patent Application Publication 2002/0010641 
Al) . 

Regarding claims 40-41 and 49: Sugiyama in view of 
Chino does not disclose expressly that said user interface 
is configured to allow a user to control a multimedia 
server, encryption hardware, and/or a radio receiver. 

Stevens discloses a user interface (figure 3(104) of 
Stevens) configured to allow a user to control a multimedia 
server (para. 53, lines 6-10 of Stevens), encryption 
hardware (para. 54, lines 1-9 of Stevens), and a radio 
receiver (figure 3 (110) and para. 36, lines 1-8 of 
Stevens) . 

Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely 
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the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to configure said user 
interface to allow a user to control encryption hardware 
and a radio receiver, as taught by Stevens. The motivation 
for doing so would have been to allow users to retrieve 
desired distributions of audio and video data over a 
controlled broadcast (para. 4, lines 1-5 of Stevens) . 
Therefore, it would have been obvious to combine Stevens 
with Sugiyama in view of Chino to obtain the invention as 
specified in claims 40-41 and 49. 

Regarding claims 59-61, 69 and 77: Sugiyama in view 
of Chino does not disclose expressly that the second output 
device is an embedded multimedia server, audio encryption 
hardware, video encryption hardware, a satellite radio 
receiver and/or a wireless device. 

Stevens discloses controlling as an output device an 
embedded multimedia server (para. 53, lines 6-10 of 
Stevens), audio encryption hardware (para. 54, lines 1-4 
and para. 57, lines 3-4 of Stevens), video encryption 
hardware (para. 54, lines 1-4 of Stevens), a satellite 
radio receiver (para. 36, lines 1-6 of Stevens), and/or a 
wireless device (para. 36, lines 1-6 of Stevens). As is 
well-known in the art, a satellite radio receiver is a type 
of wireless device. 

Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely 
the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to have the second 
output device be an embedded multimedia server, audio 
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encryption hardware, video encryption hardware, and/or a 
satellite radio receiver, as taught by Stevens. The 
motivation for doing so would have been to allow users to 
retrieve desired distributions of audio and video data over 
a controlled broadcast (para. 4, lines 1-5 of Stevens) . 
Therefore, it would have been obvious to combine Stevens 
with Sugiyama in view of Chino to obtain the invention as 
specified in claims 59-61, 69 and 77. 

16. Claims 46, 64, 66-68 and 71 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Sugiyama (US 
Patent 5,633,723) in view of Chino (US Patent 6,118,888), 
Stevens (US Patent Application Publication 2002/0010641 
Al), and McCarthy (US Patent 6,296, 693 Bl) . 

Regarding claim 46: Sugiyama in view of Chino does 
not disclose expressly that said user interface is 
configured to allow a user to control a two-way radio. 

Stevens discloses a user interface (figure 3(104) of 
Stevens) configured to allow a user to control a radio 
receiver (figure 3(110) and para. 36, lines 1-8 of 
Stevens) . 

Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely 
the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to configure said user 
interface to allow a user to control a radio receiver, as 
taught by Stevens. The motivation for doing so would have 
been to allow users to retrieve desired distributions of 
audio and video data over a controlled broadcast (para. 4, 
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lines 1-5 of Stevens) . Therefore, it would have been 
obvious to combine Stevens with Sugiyama in view of Chino . 

Sugiyama in view of Chino and Stevens does not 
disclose expressly that said radio is specifically a two- 
way radio, 

McCarthy discloses using a two-way (CB) radio (column 
7, lines 13-16 and lines 21-23 of McCarthy) . 

Sugiyama in view of Chino and Stevens is combinable 
with McCarthy because they are from similar problem solving 
areas, namely the control of data communication hardware* 
At the time of the invention, it would have been obvious to 
a person of ordinary skill in the art to provide for user 
control of a radio, as taught by Stevens, wherein said 
radio is specifically a two-way radio, as taught by 
McCarthy. The motivation for doing so would have been to 
provide the user with means of personal communication. 
Therefore, it would have been obvious to combine McCarthy 
with Sugiyama in view of Chino and Stevens to obtain the 
invention as specified in claim 46. 

Regarding claims 64, 66-68 and 71: Sugiyama in view 
of Chino does not disclose expressly that the second output 
device is a two-way radio, a radio receiver for receiving 
AM signals, a radio receiver for receiving FM signals, a 
radio receiver for receiving short wave radio signals, 
and/or an emergency alert monitor for receiving emergency 
broadcast system alerts. 

Stevens discloses controlling as an output device a 
radio receiver (para. 36, lines 1-6 of Stevens) . 

Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely 
the control and processing of time-based media data. At 
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the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to have the second 
output device be a radio receiver, as taught by Stevens. 
The motivation for doing so would have been to allow users 
to retrieve desired distributions of audio data over a 
controlled broadcast (para. 4, lines 1-5 of Stevens) . 
Therefore, it would have been obvious to combine Stevens 
with Sugiyama in view of Chino. 

Sugiyama in view of Chino and Stevens does not 
disclose expressly that said radio receiver is a two-way 
radio, a radio receiver for receiving AM signals, a radio 
receiver for receiving FM signals, a radio receiver for 
receiving short wave radio signals, and/or an emergency 
alert monitor for receiving emergency broadcast system 
alerts . 

McCarthy discloses output devices including a two-way 
(CB) radio (column 7, lines 13-16 and lines 21-23 of 
McCarthy) , a radio receiver for receiving AM signals 
(column 7, lines 13-16 and lines 20-21 of McCarthy), a 
radio receiver for receiving FM signals (column 7, lines 
13-16 and lines 20-21 of McCarthy), a radio receiver for 
receiving short wave radio signals (column 7, lines 13-16 
and lines 21-23 of McCarthy) , and/or an emergency alert 
monitor for receiving emergency broadcast system alerts 
(column 7, lines 13-16 and lines 18-20 of McCarthy) . 

Sugiyama in view of Chino and Stevens is combinable 
with McCarthy because they are from similar problem solving 
areas, namely the control of data communication hardware. 
At the time of the invention, it would have been obvious to 
a person of ordinary skill in the art to provide for user 
control of a radio, as taught by Stevens, wherein said 
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radio is specifically a two-way radio, a radio receiver for 
receiving AM signals, a radio receiver for receiving FM 
signals, a radio receiver for receiving short wave radio 
signals, and/or an emergency alert monitor for receiving 
emergency broadcast system alerts, as taught by McCarthy. 
The motivation for doing so would have been to provide the 
user with means of personal communication. Therefore, it 
would have been obvious to combine McCarthy with Sugiyama 
in view of Chino and Stevens to obtain the invention as 
specified in claims 64, 66-68 and 71. 

17. Claim 48 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sugiyama (US Patent 5,633,723) in view of 
Chino (US Patent 6,118,888) and Wedekind (US Patent 
5, 115, 967) . 

Regarding claim 48: Sugiyama in view of Chino does 
not disclose expressly that said user interface is 
configured to allow a user to control a climate sensor. 

Wedekind discloses computer control (column 4, lines 
53-58 of Wedekind) of a climate sensor (column 5, lines 3-9 
of Wedekind) . 

Sugiyama in view of Chino is combinable with Wedekind 
because they are from the same field of endeavor, namely 
the control and processing of time-based data. At the time 
of the invention, it would have been obvious to a person of 
ordinary skill in the art to configure said user interface 
to allow a user to control a climate sensor, as taught by 
Wedekind. The motivation for doing so would have been to 
control the overall climate of the room or building in 
which the printer system user is located. Therefore, it 
would have been obvious to combine Wedekind with Sugiyama 
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in view of Chino to obtain the invention as specified in 
claim 48. 

18. Claim 70 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over ' Sugiyama (US Patent 5,633,723) in view of 
Chino (US Patent 6,118,888) and Rowe (US Patent Application 
Publication 2001/0003846 Al). 

Regarding claim 70: Sugiyama in view of Chino does 
not disclose expressly that the second output device is a 
weather alert receiver. 

Rowe discloses controlling as an output device a 
weather alert receiver (para. 62, lines 3-6 of Rowe) . 

Sugiyama in view of Chino is combinable with Rowe 
because they are from the same field of endeavor, namely 
the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to use a weather alert 
receiver as an output device, as taught by Rowe. The 
suggestion for doing so would have been that weather alert 
data is simply another form of useful multi-media data that 
a user may wish to obtain. Therefore, it would have been 
obvious to combine Rowe with Sugiyama in view of Chino to 
obtain the invention as specified in claim 70. 

19. Claim 72 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sugiyama (US Patent 5,633,723) in view of 
Chino (US Patent 6,118,888) and Abgrall (US Patent 6,373498 
Bl) . 

Regarding claim 72: Sugiyama in view of Chino does 
not disclose expressly that the second output device is a 
weather alert receiver. 
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Abgrall discloses controlling as an output device 
hardware for performing VGA screen captures (column 12, 
lines 6-8 of Abgrall) . 

Sugiyama in view of Chino is combinable with Abgrall 
because they are from the same field of endeavor, namely 
the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to use hardware to 
perform VGA screen captures, as taught by Abgrall. The 
suggestion for doing so would have been that a VGA screen 
capture is simply another form of useful multi-media data 
that a user may wish to obtain. Therefore, it would have 
been obvious to combine Abgrall with Sugiyama in view of 
Chino to obtain the invention as specified in claim 72. 

Conclusion 

20. Applicant's amendment necessitated the new ground (s) 
of rejection presented in this Office action. Accordingly, 
THIS ACTION IS MADE FINAL. See MPEP § 706.07(a) . 
Applicant is reminded of the extension of time policy as 
set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final 
action is set to expire THREE MONTHS from the mailing date 
of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the 
advisory action is not mailed until after the end of the 
THREE-MONTH shortened statutory period, then the shortened 
statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the 
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statutory period for reply expire later than SIX MONTHS 
from the date of this final action. 

Any inquiry concerning this communication or earlier 
communications from the examiner should be directed to 
James A. Thompson whose telephone number is 571-272-7441. 
The examiner can normally be reached on 8 : 30AM-5 : 00PM. 

If attempts to reach the examiner by telephone are 
unsuccessful, the examiner's supervisor, David K. Moore can 
be reached on 571-272-7437. The fax phone number for the 
organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may 
be obtained from the Patent Application Information 
Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or 
Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For 
more information about the PAIR system, see http: //pair- 
direct .uspto . gov. Should you have questions on access to 
the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free) . 



James A. Thompson 
Examiner 
Division 2625 
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